DOCDHEST fiESUSB 



ED 120 226 



TH 005 185 



AOTHOE 
TIT12 



INSTITOTIOK 

POB DATE 
BOTE 



EDHS PaiCE 
DESCEIPTOBS 



IDEKTIFISBS 



Speber, Edward D*; And Others 

Individual student and Classrooa Beports: Explanatory 
flaterials. The second Heport of the 197*1-75 Hichigan 
Educational Assessment Prograott 

Hichigan State Dept* of Education, Lansing* Eesearch, 
Evaluation, and Assessment services* 

Oct 

36p«; Por related documents, see ED 059 257, ED 073 
139, ED 10tJ 897-900 and ^66*967^ TH 005 175-180 and 
184-186; Charts laay be of marginal legibility due to 
poor reproducibility of original 

,HP-$0*83 HC-$2*06 Plus Postage 
Attitude Tests; Behavioral Objectives; Criterion 
Beferenced Tests; ^Educational Assessment; Elementary 
Education; Grade 4; Grade 7; Mathematics; Beading; 
♦state Programs; Testing Programs; ♦Test 
Interpretation; ♦Test Besults; Verbal Tests 
♦Hichigan Educational Assessiaent Program 



ABSTBACT 

In the 1973-74 Hichigan Educational Assessment 
Program (HEAP), new objective-referenced tests measttring some of the 
state-level minimal ma thematics an d readin g_p^rformancg_j^^ 
were 1,'ntroduced* These^^tests and tlTe reports of results provided 
classroom teachers vith extensive information about the performance 
objectives* Tests similar to those used in the 1973*7tj program were 
included in the 197*1-75 program* This manual was prepared to help 
local educators interpret the information provided for individual 
students and for classroom groups* This booklet has four sections* 
section one describes the tests used in the 1974-75 educational 
assessment program* The second section d^escribes and illustrates the 
various report forms used to provide individual student and classroom 
data* The third section includes aids in interpreting the information 
contained in the reports. A list of cautions thai should be exercised 
in the interpretation of these results is in the final section* The 
mathematics and reading performance objectives contained in the 
educational assessment program at grades 4 and 7 are given in the 
appendix* (Author) 



* Ddcttments acquired by EBIC include many informal unpublished ^ 

♦ materials not available from other sources* EBIC makes every effort ♦ 

* to obtain the best copy available* nevertheless, items of marginal ♦ 

♦ reproducibility are often encountered and this affects the quality * 

* of the microfiche and hardcopy reproductions EBIC makes available , ♦ 

♦ via the EBIC Document Beproduction service (EDRs) * EDBS^ is not ♦ 

♦ responsible for the. quality of the original document* Beproductiohs * 

* supplied by EDBS are the best that can be made from the original. ♦ 



^^ssment Program • Michigan EducationalAsseissrn©^^ As^^5Sfnerit^^M 
ar^VMichig^ Educational Assdssment Prdgi^ • Mtchigah Educational Assessrnant Prb9ram:«;Mic^^ 
TcfucatichsfrAsseasriieht Prograni if-Mich 
c^^an Educational Assess rnant Prograrh V 

=^ P'^ogram • Michigan Educs^tiorial Assess^^^ Program e^Michigari-Educ^tioM^ 

essment Froorarh • Michigan Educational As$dS5rn^ht;F,^aran> •;MichlQ^ Edu 

• Mfchigan^ducatfohal A$5e$srnant'prbgra^^ 

catibnal Assessrnent Program V Educational Assea^ 

ic^i^anXducatiohat Assoasrmnt-P Prpgram;^.'Michigah=Eduj:att6ha^ 
^ent P-pgrarh •■Michigan Edtxational Assessment Program •^lUict^igah Ediicatjohal Assessment PiDgfam ^ Vlch^^^ 
Assessment Program • Michigan'Educational/Assessmeht P^ 

^am> Michigan Educational Assessme Educational Ass^friant Program •.Mtchigah,EducattQ^^ 

Educational Assessrnaht'Prbgfani •'MichigaaEducationarAsisessment Prbgr^^ Assessmetit Program- 

chman Educiattonal A3s&ssmant\Pr6Qram>>t^^^^ 

^ Program • Michigan. Educationa' Assessment Progr^ • Michigan Educationar^sessmar^t'Rrogram EdiicaiionE. 
^ d53mer>t Prograrri • Michigan EducationaPAssessment'P^gram VM 

• Michigan Educatibrial Assessment Program • Michigan Educattonal Assessment Program' •^Michigan Educattonat Assessm* 
catkjr^al A$sessmef)t Programs Mich^ Educatiohal;A$3ess;nai>tiPjpgfaft^^^^^^^ 
ct^jgan Educational/Assessmeht Pi'ograrn AsSsessnient Prograrn •-MJqhigaf) Educatlona* Assessment F 
'^et t Program • Michigan, EdOcationaKAssessmeht'Prbgram • Michjgan^Edul^tionalAssesirne^^ Pfogfarttiii^lchigan^Educatr 
A5&d5Sf^*ert Prooran • Michigan Eclucational^Assessmant (?roQ^^ •^ichlganiEducatlDnarAimssmei^ 1 

•^^*^H*^;.^ F/i.:raF.fi.ftal Assessment R-ogram^Michtgaii auc^tlona^ 

ogram • MIchiganEducattonaTAssessment Program Pragrani ' 

. . Ht , . Tient Prbgrani • Michigan EducatioHal. Assessment Pibgr^ •:Mrchigaj>£ducifti6hal AssesstnontP 

^ - cattohaVAssessment Program • Michigah!Educati6had:A^ 

y , ^ ' ' an Educational AssessmentProgram ^ Michic^n Edu^^^ 

isessment Prog ran^ • Michigan EducatlonarA^ 

am • Michigan Educational Assiessmani Programi Mfc^^ 

iment Prc^ram • Michigan Educational Ass&smehrPrograht^Mch^an^ 

:ducatl6nal'As3e^mmt Program •!Mfc^ 

^higan Educational Assessment Prog^ 

I Assessrnent Prpgraiti • Michigan Educational Assessirrm ^d^cati6nal Assess^ 

ogrann ^ Michigan EducatiohaTAssessmerit Pn^ 
.^mem^Prograrn • Michigan EdUcationtd'As^essme 
eni Program rMchigan Educational /bsessment Programc^ Michigan Educatk3h£U^>^^ 
^sessment program, • Michtgan Educational Asssssnrw 
arn ^ Michigan Educadohai Ass^ssmam Program • Michigan^Educationai Ass^ 

ducatidria} Assessment Prdgmm ^iMichigan Educational Assessmertt. Program %Mct\\g9rt Educatlotiai ^s99smBrrt>Pn>g^ 4, 1^ 
Michigan Educational Assessrrieht Program • MicHigaaEducatton^ Assea^ht Pr l^oh^ttt , Educational As^^ii^^ 




taal.A^sessment Pragram • Mich^^ 
>ragram • Michigari'Ecw 
iucatlona) Assessment Pragr^ 

ationat AsbessmM Program 



gan Educationat 



00 





^v. I. 



Dr,;Gorlpn/Rietto V 



J: 



Chelsea, , ^t,;, -'.J , ^1 ". ' 

^Barbara ■-:^,-;ijUniioucKisl|ei ^esfiiii^ai^ " '^'■^'-^^1^ "'-'^ y.' 

■droaseile: . ... . . . . . . ......... , l.j:Jidi^-^,^$:^^^^\ ■ - -f- C 



■^itf^mems v v. . ; . .v^ v.^ , : ; ^ v JJ aty^^ij ^ ' , ........... 

■Annette. MiHer ; , , , . " <f"H;:v','i N,,^- v s^-.^,:^ 

Huntington ^Wdbda. !.;.>,^/.«v.;Jan;^%i^^ > ' " ' ^ j^-^ "C-J 

/ 



HojughtQ0: < - 

Ghalwnan, ;]|x-p^f iciO' , - 

♦Resigned August 1974' ^ - ^ 



3^ 



INDIVIDUAL STUDENT AND CLASSROOM REPORTS: EXPLANATORY MATERIALS 



The Second Report of the 1974-75 
Michigan Educational Assessment Program 
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FOREWORD 



The Michigan Educational Assessment Program (MEAP) was initiated by the State Board of 
Education, supported by the Governor, and funded by the Legislature initially through enactment of Act 
307 of the Public Acts of 1969, and subsequently under Act 38 of the Public Acts of 1970. This report, 
the second in the 1974-75 series of MEAP reports, provides information which should assist the school 
district staff in the interpretation of the individual student and classroom educational assessment 
reports In coming months, staff of the Michigan Department of Education will conduct a series of 
workshops designed to assist local educators in interpreting and utilizing the educational assessment 
results It is hoped that the information provided in the educational assessment reports will be useful 
to educators and citizens in improving the education of all Michigan children and youth. 

Thanks are due to a large number of individuals and groups for their cooperation with and 
assistance to the Department in developing the educational assessment program. Educators and other 
citizens were involved in the development and reviews of the performance objectives which form the 
basis^o^.the.objective-referenced-reading and mathematics tests used in' the 1974-75'educational 
assessment program The tests themselves were developed by Michigan educators and validated during 
the 1972-73 school year in several Michigan school districts. The program was designed and 
administered by the Research, Evaluation, and Assessment Services (REAS), Michigan Department of 
Education, with the assistance of Measurement Research Center, Iowa City, Iowa, and the advice of the 
REAS Council 

This report was prepared by Dr. Edward D. Roeber, with the assistance of Dr. David Donovan, 
Dr Ronald L. Fishbein, Dr. Thomas H. Fisher, Mr. Robert Huyser, and Mrs. June Olsen. Questions 
or requests for additional information relative to this report should be directed to the educational 
assessment staff. 



John W. Porter 

Superintendent of Public Instruction 
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INTRODUCTION 



In the 1973-74 Michigan Educational Assessment Program (MEAP) new objective-referenced tests 
measuring some of the state-level minimal mathematics and reading performance objectives were 
introduced. These tests and the reports of results provided classroom teachers with extensive 
information about the performance objectives. Tests similar to those used in the 1973-74 program were 
included in the 1974*75 program. This manual was prepared to help local educators interpret the 
information provided for individual students and for classroom groups. 

This booklet has four sections. Section one describes the tests used in the 1974-75 educational 
assessment program. The second section describes and iHustiates the various report forms used to 
provide individual student and classroom data. The third section includes aids in interpreting the 
information contained in the reports. A list of cautions that should be exercised in the interpretation of 
these results is in the final section. The mathematics and reading performance objectives contained in 
the educational assessment program at grades 4 and 7 are given in the APPENDIX. 



SECTION J 

DESCRIPTION OP THE EDUCATIONAL ASSESSMENT MEASURES 



The 1974-75 Michigan Educational Ai?±iesbment Program (MEAPJ utilizes four different measureis^ 
mathematics, reading, and Word Relationships tesUi, and the Pupil Attitude Questionnaire, The 
mathematics and reading tests are objective -referenced ioistrument^ written to measure; certain minimal 
performance objectives. The list of minimal performance objectives measured hy each test is given in 
the APPENDIX, The performance objectives used in the 1974-75 educational assessment program 
were selected from the entire set developed by subject-matter specialists and lay citizens in 
cooperation with the Department of Education. The total set represents the minimal expectancies 
appHcable to all fourth and seventh grade students in the state by the end of third and sixth grades 
rebpectuel>. These objectives are not intended to cover the entire range of skills which some students 
might achieve in these areas by the end of third or sixth grade. 

The Word Relationships test provides a norm -referenced measure of developed verbal aptitude. 
Because it the same test used previously in the Michigan Educational Assessment Program, it can be 
used as a link to previous MEAP data at the school and school district levels. 

The Pupil Attitude Questionnaire measures attitudes toward school and self. 

The mathematics and reading tests contain five test items to measure each performance objective. 
The test items for the mathematics and reading test^ were written by classroom teachers from four 
Michigan school districts. These items vvere reviewed and edited by a technical support contractor and 
tried out in five Michigan school districts. The data gathered in the tryouts and reviews by subject- 
matter specialists were utilized in preparing final test copy. After the tests were used in the 1973*74 
program^ mathematics and reading »pecialtsts reviewed the objectives and the tests and recommended a 
number of changes in the tests. The tests used in the 1974-75 educational assessment program- were 
changed from those used in the 1973*1974 program as a result of these recommended changes. 
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Mathematics 

Onl> some of the minimal mathematical performance objectives were selected for use in the 1974-75 
educational abi>eb^mt;nt program becau^ of te^^ting time limitation^* The objective:^ chosen represent 
bome of the more important objectives for the end of third and sixth grades, but it should be noted 
that other important minimal performance objectives for these grade±> are not included in the 1974-75 
assessment program. 

The fourth grade mathemattcb te^t measures thirty minimal performance objectives, the seventh 
grade mathematicb tt^t mea^uresi fort> pt^rformance objectives* Each mathematics test includes problems 
presented orall> hy the te^t administrator. Both tests are unCimed, allowing the students to work at 
their own pace. Student ard classroom scores are reported separately for each objective, 

Reading 

The fourth grade reading te^t includes measures of nineteen performance objectives, while the 
:»eventh grade test includes measures of twenty performance objectives. The reading performance 
objectives emphasize* what-most reading speaalists'^would'consider-t^o be comprehensi The fourth 
grade test includes items, read by the test administrator. As with the mathematics tests, the reading 
tests are untimed and student performance is reported separately on each objective. 

Word Relationships (Optional) 

The optional fourth and seventh grade Word Relationship^ test^ are identical to the tests taken by 
all students in the 1972*73 and 1973-74 educational assessment programs. These measures were 
constructed according to specifications developed jointly by Educational Testing Service and the 
Michigan Department of Education, 

The fourth grade Word Relationships test contain^ forty-five verbal analogy problems designed to 
measure students' knowledge of the meaning of words and the relatii^nships between words and 
concepts. Twenty minutes is allowed to work on the test. The seventh grade test contains thirty-eight 
questions of the same type. The time allowed to work on this test is fifteen minutes. 
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9 Pupil Attitude Questionnaire (Optionat) 

'^The Michigan Department of Education with the Assistance of Educational Testing Service has 
developed measures of two attitudes. (1) attitude toward school and (2) attitude toward self. The 
development of the!>e attitude measures wa^ begun in 1971. This Questionnaire is identical to the one 
offered on an optional basis in the 1973-74 educational assessment program. 

The Pupil Attitude Questionnaire consists of 30 questions, fifteen questions measuring each 
attitude. The tests are untimed and the questions are read to the students by the assessment 
administrator. Reports provided include results for each test item and a distribution of pupil scores un 
each attitude. 
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SECTION II 

DESCRIPTION OP THE EDUCATIONAL ASSESSMENT REPORTS 



A, Mathematics, Reading and Word Relationships Results 

Local educators will receive one report that describes individual student performance »nd two 
reports that summarize student pt^rformaace at the classroom le\el. These reports are. (1; the Individual 
^Student Report, (2) the Classroom Lifting, and (3) the Classroom Summary. Basically, the fonns used to 
report results are uachanged from the 1973^74 Program. The only major change is the organization of 
the seventh grade classroom results to provide separate reports for the mathematics teacher and the 
reading or English U^acher. This should increase the usefulness of the seventh grade results in junior 
high school classrooms. 

Each of these reports is illustrated and described in this section. Except as described above> the 
format of the grade 4 and grade 7 reports are identical, therefore, only the fourth grade reports are 

sh own. The major ^ectiotki of each report are l abeled w i th lette rs in o rder to clarify the references to ^ 

them in the text. 

Individual Student Report 

The Individual Student Report, shown in FIGURE 1 as a reduced facsimile of the actual report, 
pre^enta a student s performance on each test item for all of the math<£matics and reading performance 
objectives. The students status on each performance objective is given as well as his performance on 
the Word Relationships test if this optional test was elected by the district. One report sheet !s 
provided for each student who participated in the program. 

As can be seen in FIGURE 1, Section A at the top of the report contains identification 
information, including the pupil name, teacher name, school building, and school district. Immediately 
below this is the mathematics section of the report. The method of reporting is the same for 
mathematics and reading. 
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DATE OF TESTING, in/7t| 



CHfiONOlOGiCAl AGE <) - II 



WORD RELATIONSHIPS 

RAW SCORE: 23 STANDARD SCORE: 46 

PERCENT BELOW: 40 



COMMENTS: 



The numbers dii&igned to each mathematics and reading objective appear in Section B. A brief 
de&cription of each of the objecttve:> appears in Section C immediatel> below the objective number on 
tht; £,lantod ljne:>. The:>e de:>cription£3 are detjigned U> remind the educator of the complete wording of 
the objectiveii found in the APPENDIX or in the booklets of minimal performance objectives which 
have been sent to each school district. 

Section D shows the ^'OBJECTIVE ATTAINED? ' line. This indicates whether or not the student 
attained each objective. If the :>tudent has attained the objective^ there is a capital letter Y (for YES) 
in the box. If the student has not attained the objective^ there is a capital N (for NO) in the box. The 
:>tudent mu:>t an;>wer correctl> at leaat four of the ftve test items measuring each objective in order to 
be scored as att<tining the objective. If the "OBJECTIVE ATTAINED?** line is left blank, this indicates 
tht. student did not attempt enough of the que:>tions for his status on the performance objective to be 
determined. 

Section E indicate:> the test item numbers that mea^jure each objective and whether the ^student's 
re£ipon:>e:> were correct or incorrect for each item. A correct response is indicated with a plus d) sign. 
An incorrect re:>ponse i^, :>hown b> a letter mdicating the students incorrect choice. An asterisk {*) is 
used to indicate that the student did not respond to an item. 

Section F shows the total number of jtems the student correctly answered for each objective. 

The Reading portion of the report (Section I) contains information similar to the Mathematics 
portion. Both £,ection±^ indicate how each test item for each objective was answered and whether the 
:>tudent hda attained t^ach objective. Inasmuch db the mathematics and reading tests are not designed to 
rank students on overall achievement^ total jcores and percentile ranks are not given* 

Section C» lower right-hand corner of the report^ will include the Word Relationships scores if the 
school district elected to administer this test. The labels and the results will be computer printed^ 
Because the Word Re]ation;>hipi? te:>t ji> norm- re fere need and designed to rank students on developed 
verbal abilit>> total scores tnot individual it&m responses) are provided. The students raw score and 
j>tandard score» at? well aa percent below» are given. The percent below score indicates the percentage 
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of fourih Or seventh graders tested in October^ 1973> scoring below the individual students standard 
score. The October, 1973^ statewide score distribution was used in the 1974-75 program as the basis for 
reporting percentile rsnks. 

The "COMMENTS'* section of the Individual Student Report^ Section H> is for the convenience of 
educators who receive and use the report. It can be used to make notations regarding the student's 
performance and to note highlights of the test report. Because of space limitations, this space is not 
provided on the seventh grade report forms. 

The grade seven version of the report 13 similar^ except that the first copy is perforated^ so that 
one part can be sent to the mathematics teacher and theother to the English teacher..The second copy 
is not perforated and may be placed in a ct^ntral file or in the student s record. The identification 
information is printed both on the top and bottom half of the form, so that the records can be 
identified easily. 

Classroom Listing Report 

ITie Classroom Listing Report is used to summarize the information contained on the Individual 
Student Report for an entire classroom. It allows the local educator to examine quickly the status of all 
students in the classroom on each mathematics and reading objective. An example of the Classroom 
Listing Report for grade 4 mathematics is shown in FIGURE 2, Similar reports will be provided for the 
reading objectives. Essentially, the "OBJECTIVE ATTAINED^ line from alt of the Individual Student 
Reports for a classroom are repeated in this report. 

S^tion A of the report provides the identification, teacher, name^ school building, and school 
district. Section B contains the objective number which is the dame number as used on the Individual 
Student Report. The objective descriptions shown in Section C of this report are identical. to those used 
on the Individual Student Report. 
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Section D contains the information on each student in the classroom by objective. Each student's 
name is printed in the left-hand column and his status on each objective is printed on the line across 
from his name. Again, attained objectives are indicated with a capital letter Y (for YES), and 
objectives not attained are indicated with a capital N (for NO). 

Section K typed at the bottom of the list of students, shows the percent of students iu the 
classroom who have attained each of the objectives. This will allow local educators to assess quickly the 
status of the entire classroom on each objective. By summarizing each student's status on each 
objective on one sheet, an educator can determine readily which students need additional help to 
attain certain performance objectives. 

There are also tvo seventh grade Classroom Listing Reports — one for Mathematics results and one 
for Reading results The Mathematics results are reported for each mathematics teacher coded on the 
seventh grade answer dieet. The Reading results are organized by the English teachers coded on the 
answer sheets. 

Ctassroonu School Or District Summary Form 

The Classroom, School or District Summary Form is used to report summaries of the assessment 
data at three levels: for each classroom, for each school, and for each school district. For purposes of 
this discussion, only the classroom version of this report form is illustrated and explained. 

An example of the first page of this two-page report is shown in FIGURE 3. The second page is a 
continuation of the information provided on the first page. As with the other reports, each major 
section of this facsimile is marked with a letter for purposes of explanation. 

Section A of the report contains the necessary identification information; the type of report 
^'whether a classroom, school, or district summary), the district name and five-digit district code^ the 
school name and the four-digit school code, and the grade tested. 

Section B shows the percent of students who correctly responded to 0, 1, 2» 3, 4^ or 5 items for 
each of the objectives. These frequency distributions show how close students who did not attain an 
objective came to attaining U. 
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Section C of the report shows the percentage of pupils who attained each objective. This figure is 
identical to the percentage given in Part E of the Classroom Listing Report. Section D shows the total 
number of students in the class who were teat«^d. Sections E and F contain the ^ame objective numbers 
and descriptions as given on the Individual Student Report and the Classroom Listing Report. 

The objective codes given in Section G refer to the coding system used in the complete set of , ^ 
mathematics and reading objectives. Both the objectives and the coding i^ystem have been distributed to 
each Michigan school district, and are shown also.in the APPENDIX. 

Section H summarizes the Word Relationships test. Iliis summary contains a standard score 
distribution which shows the number and percent of students' scores falling in each standard score 
interval The total number of students who took the Word Relationships test is also provided. Section I 
is used to present data on district and school human and financial resources. Because this information 
ts not collected at the classroom level, no resource information is available for the Classroom Summary. 
This space is left blank on the classroom reports. 

B. Pupil Attitude Questionnaire Results 

Two reports are provided at the classroom level to districts which elected the Pupil Attitude 
Questionnaire option. These reports are. (1) the Pupil Attitude Questionnaire Report, and (2) the Pupil 
Attitude Questionnaire Summary. 

Pupil Attitude Questionnaire Report 

FIGURE 4 shows a facsimile of the Pupil Attitude Questionnaire Report. Iliis Report is provided 
for every district^ every school, and every classroom that was separately identified. "Hie information 
provided in the Pupil Attitude Questionnaire Report may suggest particular aspects of students' 
attitudes that may be contributing to the overall test results. 
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Each major section of the form is marked with a letter for purposes of explanation. Section A 
identifies the district, j^chool, grade and number of pupils* Section^} B and C show the testing results 
separately for each attitude* The data for questions 1, 3, 5, 7, 8, 10, and so forth which measure 
Attitude Toward School, appear together across the middle of the page in Section B* Under each 
question is :>hown the percent of pupils who gave each response, true, not sure, fal&e, or no response. 
An aat^ri^k identifies whether a true or false response was counted as favorabW, Section C contaios the 
data for questions 2, 4, 6, 9, and so forth, which measure Attitude Toward Self and appear together 
across the bottom of the page. The information provided is shown in the same format as that for 
Attitude Toward School* 

Pupil Attitude Questionnaire Summary 

FIGURE 5 bhow^ a facsimile of the Pupil Attitude Questionnaire Summary. Section A identifies the 
di^tritt namu and number, school name and number, teacher, grade level and number of students tested* 
Below Section A, the attitude results are given in two broad columns. Attitude Tuward School results 
are prebented in the left columns and Attitude Toward Self are given in the right columns* The results 
for each attitude provide the following information. (1) raw score> (2) converted score, (3) percent of 
pupiU, and (4j number of pupils. The raw score is found by counting each favorable response as a plus 
une, each unfavorable response as minus one, and each "not sure" response as zero. The raw scores 
are the total uf the^e for the fifteen items that measure each objective. The converted score, and the 
interpretation given to each score are shown below: 

Raw Score Converted Score Interpretation 

10 to 15 5 Very Favorable 

4 to 9 4 Favorable 

'3 and 3 3 Neutral 

-4 to -9 2 Unfavorable 

-10 to -15 1 Very Unfavorable 

The third and fourth columns show the percent and number of students who earned each converted 
score. 

After all data have been processed, a statewide summary will be distributed to all districts along 
^ith a liat of the districts that, administered the attitude tests at each grade level. Because the revised 
que»tjunnaired have been administered on a voluntas basis statewide* it is not possible to provide 
statewide norms. , 
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SECTION in 

INTERPRETATION OP THE EDUCATIONAL ASSESSMENT RESULTS 

A. Mathematics and Reading 

The previous section of this report described each of the report forms provided to local educators. 
The purpose of this section is to aid the local educator in interpreting the three reports in order to 
determine individual student and classioom educational needs. Educators should consider these sugges- 
tions for interpretation in light of the cautions that are given in the fourth section of this report. 

It is important to remember in interpreting these results that only a certain number of the 
minima] performance objectives have been included. The results might suggest certain instructional 
strategies to educators for helping individual students and groups of students. 

For example, hy examining the Classroom Listing Report, the educator can determine quickl> two 
things, first, the percentage of students who attained each objective, and & cond, which students have 
and have not attained each objective. The first type of information shows the extent of need in the 
classroom. Thi:> ma> suggest, if the percentage of attainment is low, that a majority of students need 
help in a particular area and large group instruction ma> be appropriate. But if the percentage is high 
^that ib, mobt of the students have attained the objective), the additional help might most appropriately 
be in the form ^f individual attention or small group instruction. The listing of which students have 
and have nut attained each objective will help the educator determine which students need additional 
assistance. 

The Classroom Summary Report ma> help show trends and patterns. Students who answered three 
out of five test items correctly are closer to attaining the objective than those who missed all of the 
items. It is possible that a single, fundamental concept contained in one test item is all that prevented 
btudents from attaining an objective. This can be determined hy referring to the ^Individual Student 
Reports and a cop> of the appropriate test booklet to determine if many students are missing the same 
test item. 
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In addition, if students who did not attain the objective mis^d most of the .test items measuring 
that objective, it ma> suggest that these students will need greater amounts of additional assistance 
than those students who correctl}^ answered three out of five test items. 

The Individual Student Reports^ because they contain so much information on each student, 
generally should be consulted after the other two reports have been examined* By using the group 
reports first, educators should be able to determine area;5 of student need. Then, the> may be able to 
pinpoint which students need additional help hy examining the appropriate Individual Student Repprts. 

It is also important for the staff of each school anct school district to consider the educational needs 
of students in the entire school or the entire school district hy examining not only the individual 
student and classroom .reports, but the school and school district summaries as well. It is possible that 
similar conditions exist in other classrooms. This would suggest that local educators should examine the 
curriculum to determine when appropriate instruction should occur and whether additional resources are 
needed, 

B. Word Relationships (Optinal) 

If the district elected the Word Relationships option, several types of secures will be reported to the 
classroom teachers. On the Individual Student Reports, each student s raw scorer standard score^ and 
percent below score will be reportec!. The raw score is the total number of correctl}^ answered test items. 
The standard score h developed from the raw score- In 1973*74, standard scores with a mean of 50 and 
a standard deviation of 10 were established, A percent below score corresponding to any given standard 
score shows the percentage of pupils tested in the 1973-74 program who received lower scores. Thus, a 
percent below score of 60 on Word Relationships indicates that 60 percent of the pupils in the state 
received ^ lower score in the 1973-74 program, and that 40 percent in the state received the same or 
higher score. 

The Classroom Summary shows the distribution of Word Relationships standard scores in the 
classroom as well as the number of students tested. 
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C. Pupil Attitude Questionnaire (Optional) 

The MEAP attitude survey was designed to provide information about attitude toward school and 
attitude toward self for large groups of students. The survey should not be expected to yield data which 
cuuld be u^ed for psychological diagnosess of individual students. The results returned to the district^ 
then, are useful primarily for providing a general impression of the prevailing student attitudes toward 
school and toward self. Local educaU>rs will have to seek supportive evidence, which may be subjective 
in nature, to validate the results and to understand better the reported scores — i.e., what causes scores 
to be low or high, what causes a particular school to score low or high, and so forth. 

If the reported scores are low and if one is reasonably convinced "why", then staff and parents can 
collectively plan change^ in the curriculum, school organization, or instructional plans which may foster 
improved attitudes toward school and toward self. These attitudes, however, are not easy to alter— 
particularly for older children—and one should not expect dramatic shifts in short periods of time. 



SECTION IV 
PRECAUTIONS IN INTERPRETING THE 
EDUCATIONAL ASSESSMENT RESULTS 



This bection preaent^ bomi: precautions which educaiora should observe ^hen interpreting the results 
contained in the three types of reports. 

The Performance Objective Are Minimal Objectives 

The performance objectives included in the assessment tests are minimal objectives. That is, these 
obje<:li\es co\t;r bome of the skills which most fourth and seventh grade students should possess. They 
do not co\er the entire range of what educators would consider important for many or even some 
students to kno^ in mathematics and reading at the beginning of fourth or seventh grade. Some 
i^jtudents ^ill kno^ considerabl> more in these areas than is measured by these tests. In addition, local 
school districts may have other important objectives which are unique to the local district. 

Objectives Tested Are A Sample of the Complete Set of Objectives 

Because tests designed to mea«>ure the complete sets of minimal objectives in mathematics and 
ri:ading would be prohibitivel> long, samples of the complete sets were chosen to measure. There are 
other minimal objecti\eb which were not measured, therefore, educators cannot say that students have 
attained all of the minimal objectives if they attained the objectives assessed this year. Follow-up 
dsse^^ment efforts will be needed at the local leve} to cover the entire set of mathematics and reading 
minimal pt^rformance objectives and the ttdditional performance objectives adopted by the local district. 

Criterion Levels Are Present 

The criterion level for attainment of each objective was set by the Department of Education at four 
out of five test items. Despite this high criterion level, it is still possible for a small percentage ot 
students to attain some objectives b> guesaing, since multiple-choice questions were used. For some 
objectives, the criterion level may be too high or too low. It is important that local educators consider 
this factor when interpreting their assessment results. 
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Review Objectives and Test Items Carefully 

The performance objecttses measured in thi;^ >ear'£^ educational assessment program represent a 
consensus of manv people concerning the minimal skills mgst fourth and seventh graders should 
possess. The mathematics objective^ te^^ted in the 1973*74 program were r&wie^%ed hy a representative 
gruup of the Michigan Cuuncil of Teachers of Mathematics. Some changes in content and placement of 
the objective^ ^%ere made ba^ed on their recommendations. Similar reviews were conducted on the 
reading objectives ba^ed on the results of the 1973-74 program. It is still possible, however, that a few 
of ihe performance objectives have been incorrectly placed for fourth or seventh graders. 

A few of the test items which measure the performance objectives may be less than optimal 
measures of objectives. An extensive validation procedure was used ^ eliminate poor items and 
inappropriate objectives. Ho^%e^er, It is pu^isible that some poor items and inappropriate objectives have 
not been eliminated. Local educators should be particularly careful when examining their results to 
review the objectives for appropriateness and the test items for soundness. 

ResponsibUity For Educational Needs Discovered 

The purpose of the objective referenced tests in mathematics and reading is to pinpoint specific 
educational needs of students. In attempting to establish the reason why educational needs exist, 
educators should refrain from placing blame on teachers. It is not the purpose of the objective^ 
referenced te£>t^ nor the educational assessment program to single out particular teachers for fault or 
blame^ but to encourage all of thuse involved in education (teachers, counselors, administrators, 
curriculum specialists, board members, parents, students, and others) to examine the results to 
determine ho^% the entire s>stem can bettei meet the needs of all students. Because the objectives used 
this year co\er a range of several grades (depending on the pace at which students learn), it is not 
appropriate to assume that one particular teacher is responsible for teaching those skills. This 
underscores the need fer an examination of the assessment results b> representative groups of persons 
concerned with education. 



26 

-20- 



APPENDIX 



MATHEMATICS AMD READING OBJECTIVES 
MEASURED IN THE 1974.75 MICHIGAN 
EDUCATIONAL ASSESSMENT PROGRAM, 
GRADES 4 AND 7 
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READING OBJECTIVES 
MEASURED IN THE 1974-75 
MICHIGAN EDUCATIONAL ASSESSMENT PROGRAM* 

Grade 4 

Objective 
Number 

1. 2.1 Given a reading selection at the third grade level, the learner will match a series of 

words in the selection with appropriate definitions. 

2. 2.2 Given a set of phrases, the student will indicate those phrases which have the same 

meaning. 

3. 3.2 Given a reading selection at the third grade level in which every fifth word has been 

replaced with a blank, the learner will choose the exact word appropriate to the blank 
space at 50% accuracy. 

4. 4.1 Given a method of arranging data, the learner will identify the method (e.g., color, size^ 

importance, time, etc.) 

5. 4.4 Given a series of randomly placed words, the learner will be able to alphabetize the 

words through the first three letters. 

6. 5.1 Given a series of reading selections, the learner will indicate those which are factual. 

7. 5.2 Given a series of reading selections, the learner will indicate those which are fictional. 

8. 6.1- Given a reading selection, the learner will be able to identify the author^s purpose (e.g., 
6.3 persuasion, entertainment, propaganda^ etc.) 

d. 7.1 Given a reading selection at the third grade level, the learner will select from a list of 
possible titles the one most appropriate as the title for that selection. 

10. 7.2 Given a reading selection at the third grade level, the learner will select from a series 

of still pictures the one picture most appropriate in depicting the main idea of the 
selection. 

11. 7.3 Given a reading selection at the third grade level, the learner will select from a 

number of short summaries the one which best summarizes the selection. 

12. 8.4 Given a reading selection at the third grade level, the learner will match a series of 

direct quotations from the story with the character who is speaking. 

13. 10.3 Given a reading selection at the third grade level, the learner will choose from a series 

of sentences that sentence which best describes how a given character feels in a story. 

14. 10.6 Given a selectii/n containing figitrative language^ the learner will identify from a series 

of descriptive phrases the phrase that most accurately describes the mood expressed in 
the selection. 

15. 11.1 Given a reading selection at the third grade level, the learner will correctly match a 

series of causes with a corresponding series of effects. 

* This list contains only the objectives which are included in the every -pupil. portion oflthe.l974r75 
MEAP testa. A complete set of the objectives is available in Minimal Performance Objectives 
for Communication Skills Education in Michigan, Michigan Department of Education 
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16 11 2 Given a reading selection at the third grade level with the conclusion of the story 

deleted^ the learner will select from a series of possible conclusions the one most 
appropriate to the selection. 

17 13 1 Given a locationat Question, the learner will choose from a series of reference sources 

where that item, will be found. 

18 13 2 Given a locational question about newspapers, the learner will select the section where 

he would find the answer. 

19 14 1- Given a reading selection at the third grade }evel> the learner will answer correctly a 
14 3 series of multiple choice questions relating to meanings, generalizations* or conclusions 

not expressed in the selection itself. 



ERIC 



^9. 

.23. 



READING OBJECTIVES 
MEASURED IN THE 1974*75 
MICHIGAN EDUCATIONAL ASSESSMENT PROGRAM 

Grade 7 



Objective 
Number 



1. 18.1 Given a reading selection at the sixth grade levels the learner will match a series of 

words in the selection with appropriate definitions. 

2. 18.2 Given a set of phrases^ the learner will indicate those phrases which have the same 

meaning. 

3. 20.1 Giyen a method of arranging data, ^he learner will identify the method <e.g., sequence, 

importance, etc.). 

4. 21.1 Given a series of randomly placed words, the learner will he able to alphabetize the 

words through the first three letters. 

5. 22.1 Given a series of reading selections, the learner will indicate those which are factual. 

6. 22.2 Given a series of reading selections, the learner will indicate those which are fictional. 

7. 23-1* Given a reading selection, the learner will be able to identify the author's purpose (e.g., 
23.3 persuasion, entertainment^ propaganda, etc.). 

8. 24.1 Given a reading selection at the sixth grade level, the learner will select from a list of 

possible titles the one most appropriate as the title for that selection. 

9. 24.2 Given a reading selection at the sixth grade levels the learner will select from a series 

of still pictures the one picture most appropriate in depicting the main idea of the 
selection. 

10. 24.3 Given a reading selection at the sixth grade level, the learner will select from a 
number of short summaries the one which best summarizes the selection. 

IL 24.4 Given a series of three or more reading selections at the sixth grade levels the learner 
wilt indicate the two most alike in the ideas expressed. 

12. 25.3 Given a reading selection at the sixth grade leveK the. learner will match a series of 

direct quotations from the story with the character who i^ speaking. 

13. 26.3 Given a reading selection at the sixth grade level, the learner wil] correctly answer a 

series of multiple choice questions relating to the sequence of .events or ideas presented 
in the selection. 

14. 27.2 Given a reading :$e]ection at the sixth grade level, the learner will choose from a series 

of sentences that sentence which best describes how a given character feels in a story. 

15. 28.1 Given a reading select ion. at the sixth grade level » the learner will choose from a series 

of sentences the one which best describes a motive for some action or activity. 
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16 29 1 Given a reading selection at the sixth grade levels the learner will correctly match a 

series of causes with a corresponding series of effects. ^ 

17 29 5 Given a reading selection at the sixth grade level, the learner will answer correctly a 

series of multiple choice questions relating to meanings^ generalizations^ or cohclusions 
not expressed in the selection it^lf. 

18 311 Given a locational question ^ the learner will choose from & series of reference sources 

where that item will be found* 

19 312 Given a locational question about newspapers, the learner will select, the section where 

he would find the answer. 

20 32 1 Given a reading selection at the sixth grade level with the conclusion of the story 

deleted, the learner will select from a series of possible conclusions the one most 
appropriate to the selection. 
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MATHEMATICS OBJECTIVES 
MEASURED IN THE 1874^5 
MICHK3AN EDUCATIONAL ASSESSMENT PROGRAM;* 

Grade 4 

Objective 
Number 

1. AR^I-'A^G Given a set of objects^ the learner will recognize objects that are the same 

size. 

2. AR-I-A*8 Given an object shaped like a circle^ triangle^ square^ or rectangle^ the learner 

wilt choose the shape the object represents. 

3. Ail-I'A'16 Given a set of three containers^ one full> one empty> and one half-filled* the 

learner will choose the containers that are arranged from full to empty. 

4. AR-I-A-24 Given a collection of five objects of varying lengths* the learner will identify 

the longest or the shortest* as requested. 

5. AR-I-A-39 Given five small toys in a line* the learner will identify the first toy and the 

last one. 

6. AR^I-'B*? Given a set with less than ten objects* the learner will identify an equivalent 

set 

7. AR-I-B*32 Given a set of two to eight objects* the learner will identify a set having fewer 

members than the original set. 

8. AR-I-B-40 Given a Hne marked with congruent segments and a set of number cards 

(O'lO)* the learner will choose the appropriate number card for the point on the 
line. 

9. AR-I-B-43 Given any three numbers* 0*10* the learner will identify which number is the 

greatest and which is the least* on request. 

10. AR-I-B-44 Given two consecutive even or odd numbers* 0-9* the learner will name the 

ntimber that comes between the two given numbers. 

11. AR-I'*B«45 Given a number from 1 to 8* the learner will identify the number that comes 

before or after the given number. 

12. AR-LB-64 Given a aet of tens and ones representing a number less than 100^ the learner 

will identify the numeral. 

13. AR-I-B-65 Given a set of sequentially ordered whole numbers within a decade less than 

100* such as 31* 32* , . . 40* the learner wiil identify the number that comes 
^ immediately before or after a given number* as requested. 

14. AR-I'B'67 Given 2 two^igjt numbers* the learner will tetl which number is greater and 

which number is less. 

15. AR-I'B-70 Given a set of dimes and pennies valued between 11 and 99 cents (one dime* 

one penny to nine dimes^ nine pennies)* the learner will state the value. 
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16 AR'l-B*Sl Given a random list of two- and three-digit numbers^ the learner will identify 

the list that is in ascending order. 

17 ARpI'B-S2 Given 2 three-digit numbers which have the same digits but in different 

positions^ the learner will compare them to determine which is greater and 
which is less. 

18 ARpI-B-84 Given a counting sequence of two or four numbers, the learner will write the 

next number in the sequence. 

19 AR^I-B^ Given the counting numbers 1-1 0> the learner wUl indicate ^hose that are 

multiples of 2. ^ , 

20 AR-I-B-Sd Given a set of objects, the learner will select another set that will have twice 

as many objects. 

21 AR-II-A-IO Given addition exercises involving a two-digit number plug a one-digit number 

requiring no regrouping (carrying), the learner will find the sums with or 
without the use of aids. 

22 AR-n-B-9 Given a set of objects or pictures showing a subtraction relationship with 

combinations to IS, the learner will identify an appropriate number sentence. 

23 AR-lI-B-l] Given a subtraction word problem read by the teacher involving combinations 

to 18, the learner will: 1^ identify the operation, 2) identify an appropriate 
number sentence, and 3)^ identify the answer. 

24 AR-n-B'13 Given two sets of objects, one with more objects than the other> the learner 

will identify how many more members it has. 

25 AR-II-B-IS Given a two-digit number, the learner wiU subtract one-digit numbers with no 

regrouping (borrowing) with or without the use of aids. 

26 AR'1I-B-16 Given a two-digit number, the learner will subtract a two-digit number with no 

regrouping (borrowing). 

27. M-II-A-fi Given the reading " o*clock" and a clock face> the learner will identify 

the clock showing the appropriate time. 

28 M-II-B-S Given three to five different amounts of money > all less than or equal to $5.00> 

the learner will identify the greatest or the least. 

29 M-II-C-1 Given a Fahrenheit or Centigrade thermometer, the learner will identify the 

temperature (above zero) to the nearest degree. 

30 G-I-A-2 Given pictures of various shapes* the learner will identify circles, triangles* 

squares, and rectangles as requested. 

* This list contains only the objectives which are included in the every-pupil portion of the 1974-75 
MEAP tests. A complete set of the objectives is available in the Minimal Performance 
Objectives for Mathematics in Michigan, Michigan Department of Education, 1973. The 
wording of the objectives in this APPENDIX may be different from the original wording as 
contained in the publication cited above. These minor wording changes were necessitated by the 
group*administered nature of the items developed to measure the objectives. 
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Objective 
Number 

L AR-I-B^87 



2. AR4-B^89 

3. ARJI-A-22 

4. AR.II-A-26 

5. AR4LB.20 

6. AR-II-C-6 

7. AR4LC-11 

8. AR*ILC-13 

9. AR-n-C-15 

10. AR4I-D-5 

11. AR-II-D-7 

12. ARJI.D.9 

13. AR4I-D-15 

14. AR^m-AU 

15. AR-III-A-18 



MATHEMATICS OBJECTIVES 
MEASURED IN THE 1974-75 
MICHIGAN EDUCATIONAL ASSESSMENT PROGRAM 

Grade 7 



Given any fouMigit number^ the learner will identify the number that is 100 
or 1000 more or less than it is, without using formal addition or subtraction. 

Given a number orally, the learner will identify the arabic numeral. 

Given addition exercises involving a three*digit number plus a one-t two^, or 
three*digit addenda with or without regrouping (carrying)^ the learner will 
identify the sums» using any techniques. 

Given addition problems involving two or three addends with three, four» five» 
or six digits^ with or without regroupings the learner will find the sums» using 
any techniques. 

Given a three-digit number^ the learner will subtra^ct a two or three-digit 
number^ with or without the use of aids. 

Given a repeated addition sentence^ the learner will represent it as a 
multiplication sentence with its product. 

Given two numbers^ the learner will demonstrate that the order in which they 
are multiplied does not change the product. 

Given a one-digit number and (10^0. . .)» (100,200. . .), the learner will identify 
the product 

Given a two-digit number to be multiplied by a one*dlgit number^ the learner 
will identify the product^ with or without aids. 

Given a sentence with one single digit, a missing factor, and a product (whol^ 
numbers), the learner will identify the missing factor. 

Given a division fact, the learner-will identify tt.rewritten as a multiplication 
fact 

Given a one-digit divisor (factor) and a diviidend (product), of .less than 100, the 
learner will identify the quotient (missing factor) if there is no remainder. 

Given an exercise with a dividend of four digits or less, and a one-digit divisor, 
the learner will identify the quotient 

Given several objects, some divided into congruent part3> some divided into 
noncongruent parts, the learner will identify congruent parts. 

Given a diagram divided into congruent parts, with spme parts shaded^ the 
learner will identify the shaded area by identifying an appropriate fraction. 
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AR III A 19 Given nny five fractions with like denominators^ in random order^ the learner 
will identify them in order (halves^ thirds, fourths, fifths, sixths, eighths, 
tenths); with or without the use of aids. 

17 AR 111 B-4 Given two common fractions with Hke denominators and a sum greater than 1, 

the learner wtU identify the sum, with or without the use of fractional cut-out 
parts. 

18 AR-lIl B-7 Given two mixed numbers with like denominators, the learner will identify the 

sum. 

Id AR-lll-C-4 Given a mixed number and a fraction with like denominators, of 2, 3, 4, 6, or 

8, whero no regrouping is necessary, the learner will find the difference. 

20 AR'lIl-C-6 Given a whole number and ^ common fraction with a denominator of 2, 3,4, 

6, or 8, the learner will find the difference with or without the use of 
fractional parts. 

21 AR'IH'D'4 Given two unit fractions with denominators less than seven, the learner will 

identify the product with or without the use of a model. 

22 AR'IV A-3 Given a model of a fraction illustrating hundredths, the learner will identify 

the decimal fraction as illustrated. 

23. AR'IV-A-7 Given a decimal fraction of no more than three places, the learner will name 

the place val\je of each digit, without aids. 

24 AR IV B-3 Given a verbal problem involving addition and subtraction of decimal numbers 

involving only tenths, the learner will find the answer. 

25 AR'IV- B-6 Given a verbal problem involving addition and subtro::tion of decimal numbers 

involving tenths and hundredths, the learner will find the answer. 

26 AR IV B-9 Given an addition and subtraction decimal problem in horizontal or vertical 

form with no more than five (5) digits and no more than three (3) decimal 
places, the learner will find the sum or difference. 

27 AR-Vl-15 Given a picture of sets paired in (A) a one-to-one, (B) a many-to-one, or (C) a 

one-to*many ratio and part of another pair, the learner will identify the pair 
that keeps the ratio equivalent. 

28. M*l-B*8 Given a polygon, the learner will estimate its area in square units. 

29 M I C 7 Given a drawing of a rectangular solid divided into units (dimensions less than 

or equal to 5 units), the learner will name the number of units in it. 

30. M'll'A'lQ Given a clock face with hands on it, the learner will choose the correct time 

notation. 

31. M-11*A-11 The learner will use A.M. and P.M. notation in writing time. 

32. M-II-B'7 Given two money values, the learner will add or subtract using dollars and 

cents notation. 
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33. MJI-B-9 Given verbal problems consisting of one or two operations involving money 

values less than or equal to $20» the learner will solve the problems. 

34. M'll-C-S Given a Fahrenheit or Centigrade thermometer the learner will identify 

temperatures to the nearest degree^ using the degree symbol. 

35. G-I-A-4 Given a set of quadrilaterals, the learner will identify and name a parallelo- 

gram> a square, and a rectangle. 

36. G-I^B-5 Given the description of a plane, and a part of a plane, the learner will 

identify surfaces which represent a plane or part of a plane. 

37. AL-2 Given a statement of equality involving addition, subtraction, or multiplication 

facts and containing a placeholder or letter, the learner will identify the 
missing number. 

38. AL'4 Given a pair of whole numbers or number phrases less than 1,000, the learner 

will identify the appropriate symbol of equality or inequality, < or = or >. 

39. AL.-5 Given an equation involving one or zero, the learner will complete the 

sentence. 

40. AL-V Given a numerical statement involving distributive property and a placeholder, 

the learner will insert the missing value. 
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